-  Carnegie  Mel  Ion 

_  Software  Engineering  Institute 

Pittsburgh,  PA  15213-3890 

Achieving  Success  via 
Multi-Model  Process  Improvement 

Jeannine  M.  Siviy 
M.  Lynn  Penn 
Robert  Stoddard 

SEPG  2007 

This  material  is  approved  for  public  release.  Distribution  is  limited  by  the 
Software  Engineering  Institute  to  attendees. 

Sponsored  by  the  U.S.  Department  of  Defense 
©  2007  by  Carnegie  Mellon  University 

©  2006  by  Carnegie  Mellon  University  page  1 


Report  Documentation  Page 


Form  Approved 
OMB  No.  0704-0188 


Public  reporting  burden  for  the  collection  of  information  is  estimated  to  average  1  hour  per  response,  including  the  time  for  reviewing  instructions,  searching  existing  data  sources,  gathering  and 
maintaining  the  data  needed,  and  completing  and  reviewing  the  collection  of  information.  Send  comments  regarding  this  burden  estimate  or  any  other  aspect  of  this  collection  of  information, 
including  suggestions  for  reducing  this  burden,  to  Washington  Headquarters  Services,  Directorate  for  Information  Operations  and  Reports,  1215  Jefferson  Davis  Highway,  Suite  1204,  Arlington 
VA  22202-4302.  Respondents  should  be  aware  that  notwithstanding  any  other  provision  of  law,  no  person  shall  be  subject  to  a  penalty  for  failing  to  comply  with  a  collection  of  information  if  it 
does  not  display  a  currently  valid  OMB  control  number. 


1.  REPORT  DATE 

MAR  2007 


2.  REPORT  TYPE 


3.  DATES  COVERED 

00-00-2007  to  00-00-2007 


4.  TITLE  AND  SUBTITLE 

Achieving  Success  via  Multi-Model  Process  Improvement 


5a.  CONTRACT  NUMBER 


5b.  GRANT  NUMBER 


5c.  PROGRAM  ELEMENT  NUMBER 


6.  AUTHOR(S) 


5d.  PROJECT  NUMBER 


5e.  TASK  NUMBER 


5f.  WORK  UNIT  NUMBER 


7.  PERFORMING  ORGANIZATION  NAME(S)  AND  ADDRESS (ES) 

Carnegie  Mellon  University  , Software  Engineering  Institute 
(SEI), Pittsburgh, PA, 15213 


8.  PERFORMING  ORGANIZATION 
REPORT  NUMBER 


9.  SPONSORING/MONITORING  AGENCY  NAME(S)  AND  ADDRESS  (ES) 


10.  SPONSOR/MONITOR’S  ACRONYM(S) 


11.  SPONSOR/MONITOR’S  REPORT 
NUMBER(S) 


12.  DISTRIBUTION/AVAILABILITY  STATEMENT 

Approved  for  public  release;  distribution  unlimited 


13.  SUPPLEMENTARY  NOTES 

Software  Engineering  Process  Group  (SEPG  2007),  26-29  Mar,  Austin,  TX. 


14.  ABSTRACT 


15.  SUBJECT  TERMS 


17.  LIMITATION  OF 

18.  NUMBER 

ABSTRACT 

OF  PAGES 

Same  as 

81 

Report  (SAR) 

16.  SECURITY  CLASSIFICATION  OF: 


a.  REPORT 

unclassified 


b.  ABSTRACT 

unclassified 


c.  THIS  PAGE 

unclassified 


19a.  NAME  OF 
RESPONSIBLE  PERSON 


Standard  Form  298  (Rev.  8-98) 

Prescribed  by  ANSI  Std  Z39-18 


-  Carnegie  Mel  Ion 

^  Software  Engineering  Institute 

Outline 

©  Value  Proposition 

•  Our  (Your)  Multi-Initiative  Reality 

•  Six  Sigma  &  Lean  Fundamentals 

•  Six  Sigma  as  a  Strategic  Enabler 

Multi-Initiative  Implementation 

•  Case  Profiles 

•  Strategies 

•  Tactical  Connections 

Identifying  Your  Solution 

•  Process 

•  Emerging  Research 

•  Existing  best  practices  to  leverage  today 

Summary 


©2007  by  Carnegie  Mellon  University 


page  2 


Carnegie  Mellon 

Software  Engineering  Institute 

What  Drives  Process  Improvement? 

Performance  issues:  product,  project — 
and,  eventually,  process  issues 

Regulations  and  mandates 

•  Sarbanes  Oxley 

•  “Level  3”  requirements  to  win  contracts 

Business  issues  and  “burning  platforms” 

•  lost  market  share  or  contracts 

•  continuous  cost  and  cycle  time  improvement 

•  capitalizing  on  new  opportunities 


There  is  compliance-driven  improvement, 
and  there  is  performance-driven  improvement. 
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Many  Solutions 

(not  an  exhaustive  list) 


r 

[L 

.ear 

L 

J 

What  solutions  is  your  organization  implementing? 
How  do  they  support  your  organization’s  mission? 
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Your  Expectations  /  Our  Objectives 

Ask  the  Audience 

•  What  are  your  questions?  Your  current  challenges? 

•  What  are  your  expectations  for  today? 


Our  Objectives 

•  Use  CMMI  +  Six  Sigma  implementations  and  research 
as  a  springboard  for  considering  the  broader  topic  of 
multi-model  process  improvement 

•  Enrich  our  views  of  what  SEPGs  (and  their  equivalents) 
do  and  how  they  do  it,  to  enable  efficient  and  effective 
multi-model  process  improvement 
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Frequently  Asked  Questions 

about  applying  Six  Sigma  in  Software 

"^"l  How  do  I  leverage  Six  Sigma  with  software  process  improvement 
initiatives  already  underway  in  my  organization? 

%  Should  I  pick  Six  Sigma  or  CMMI?  Or,  how  do  I  convince  my 
>  management  that  it’s  not  an  either/or  decision? 

What  evidence  is  there  that  Six  Sigma  works  in  software  and 
systems  engineering?  In  IT? 

How  do  I  train  software  engineers  when  Six  Sigma  training  is 
geared  for  manufacturing? 

What  are  examples  of  Six  Sigma  projects  in  software?  In  IT? 

Isn’t  Six  Sigma  only  about  advanced  statistics? 

Exactly  what  is  a  software  “opportunity”?  And,  how  do  I  calculate 
sigma? 
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Myths 

about  applying  Six  Sigma  in  Software 

Six  Sigma  is  only  for  high  maturity  organizations. 

It’s  all  about  statistics. 

“Six”  Sigma  is  the  right  performance  goal. 

Everything  has  to  be  six  sigma  (or  x  sigma  )  performance. 

It’s  not  for  government  contractors  who  “don’t  focus  on 
profitability.” 

“Sigma  level”  corresponds  to  defect  density. 

It  is  all  about  defect  density. 

“We’re  Level  5  therefore  we  must  be  Six  Sigma.” 

“We’re  doing  Six  Sigma  therefore  we  must  be  Level  4.” 
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What  Is  Six  Sigma? 

a  business  improvement  strategy 
a  philosophy 

a  performance  measurement 
an  improvement  framework 
a  set  of  improvement  tools 

a  critical  mass  of  highly  trained  individuals  who  serve  as 
analysts,  problem  solvers,  change  agents 
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Six  Sigma  Philosophy 

Improve 

customer  satisfaction 
by  reducing  and  eliminating 

defects 


Greater  Profits 
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What  is  a  Defect? 

Six  Sigma: 

Any  product,  service,  or  process  variation  which 
prevents  meeting  the  needs  of  the  customer 
and/or  which  adds  cost,  whether  or  not  it  is 
detected. 

•  A  non-conformance  to  a  customer-driven 
specification 

•  A  non-conformance  or  interruption  of  the  flow 
or  an  intervention  in  the  flow 
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Statistical  Thinking 

•  Everything  is  a  process 

•  All  processes  have  inherent  variability 

•  Data  is  used  to  understand  variation  and  to  drive 
decisions  to  improve  the  processes 


Data  Spread  due  to 
Common  Cause  Variation 


variation  will  re-establish  itself.) 


[ASQ  00],  [ASA  01] 
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Six  Sigma  Metrics 

Defect  Measures 

•  Defect  Rate,  parts  per  million  (ppm) 

-  “3.4  ppm”  -  most-cited  metric 

•  Sigma  Level 

•  Defects  per  Unit  (dpu) 

•  Defects  per  Million  Opportunities  (dpmo) 

•  Yield 


Practitioner  Project  Measures 

•  Defect  measures 

•  Cycle  time,  cost,  product  performance,  variability.... 

•  Bottom-line  savings 
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Example  Sigma  Levels 


•  IRS  -  Tax  Advice  (phone-in) 


Sigma  Level 

(ppm  for  shifted  process) 

[Harrold  98],  [Harry  00] 
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Six  Sigma  Improvement  Frameworks 

DMAIC:  Define  -  Measure  -  Analyze  -  Improve  -  Control 

•  improve  existing  processes  and  products  by  focusing  on  defects  &  variation 

Design  for  Six  Sigma  (DFSS) 

•  design  new  products  and  processes 

•  redesign  a  process  that  is  optimized  but  still  does  not  meet  specifications 

•  there  are  several  approaches  to  DFSS,  incl 

-  DAMDV:  Define  -  Measure  -  Analyze  -  Design  -  Verify 

-  IDDOV:  Identify  -  Design  -  Develop  -  Optimize  -  Validate 

-  CDOV:  Concept  -  Design  -  Optimize  -  Verify  [Creveling] 

-  I2DOV:  Invention  &  Innovation  -  Develop  -  Optimize  -  Verify  [Creveling] 

Lean  /  Lean  Six  Sigma 

•  Improve  existing  processes  by  focusing  on  time  &  waste 

-  Complements  DMAIC 

•  Leverages  seminal  Lean  principles*:  value,  value  stream,  value  flow, 
customer  pull,  perfection 

*  Womack,  James  P.  &  Jones,  Daniel,  T.  Lean  Thinking:  Banish  Waste  and  Create  Wealth  in  Your 
Corporation.  Simon  &  Schuster:  New  York,  NY:  1996. 
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DMAIC  Roadmap 
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[MPDI] 
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Six  Sigma  Toolkit 


Define 

Measure 

•  Benchmark 

•  7  Basic 

•  Baseline 

Tools 

•  Contract/Charter 

•  Defect 

•  Kano  Model 

Metrics  (i.e., 

•  Voice  of  the 

"ppm") 

Customer 

•  Data 

•  Voice  of  the 

Collection 

Business 

Forms,  Plan, 

•  Quality  Function 

Logistics 

Deployment 

•  Sampling 

•  Process  Flow 
Map 

•  Project 
Management 

•  "Management 
by  Fact" 

-4  What's 

Techniques 

Analyze 

Improve 

•  Cause  &  Effect 
Diagrams 

•  Failure  Modes  & 
Effects  Analysis 

•  Decision  &  Risk 
Analysis 

•  Statistical 
Inference 

•  Control  Charts 

•  Capability 

•  Reliability 
Analysis 

•  Root  Cause 
Analysis 

-5  Why's 

•  Systems 

Thinking 

•  Design  of 
Experiments 

•  Modeling 

•  Tolerancing 

•  Robust 

Design 

Control 

Statistical 

Controls: 

•  Control 
Charts 

•  Time  Series 
methods 

Non-Statistical 

Controls: 

•  Procedural 
adherence 

•  Performance 
Mgmt 

•  Preventive 
activities 
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What  About  Lean? 

Seminal  work  in  the  automotive  industry 

Principles,  per  Womack 

•  articulate  value  for  a  product, 

•  identify  the  value  stream, 

•  make  the  value  flow, 

•  establish  a  customer  pull  system  and 

•  pursue  perfection. 

Often  coupled  with  Six  Sigma 

•  Lean:  focus  on  time,  waste 

•  Six  Sigma:  focus  on  defects,  variation 

•  Overlapping  analytical  toolkits 
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L  O  C 


K  H  E  E  D  MARTIN 


Lean:  Six  Sigma  Representation 


[Penn&Siviy  03] 
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Lean  Tactics:  Kaizen  Events 

Kaizen  -  Make  people’s  jobs  easier  by  taking  them  apart, 
studying  them,  and  making  improvements. 

•  “KAI”  -  take  apart  and  make  anew 

•  “ZEN”  -  think,  make  good  the  actions  of  others,  do  good 
deeds  and  help  others 

Kaizen  tips  (VAL,  M&A,  QPM,  CAR,  OPP) 

•  Get  rid  of  old  assumptions. 

•  Look  for  ways  to  make  things  happen  now. 

•  Say  “NO”  to  the  status  quo. 

•  Don’t  worry  about  being  perfect. 

•  It  doesn’t  have  to  cost  money. 

•  If  something’s  wrong,  fix  it  on  the  spot. 

•  Ask  “WHY”  five  times  to  get  to  the  root  cause. 

•  Look  for  wisdom  from  many  people  rather  than  one. 

•  Never  stop  improving. 

•  Full-time  participation  of  team  members. 

•  Keep  all  affected  employees  informed  of  changes.  [Penn&siviy  03] 
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Lean  Tools 

Many  tools  shared  with  “traditional”  Six  Sigma 

•  brainstorming,  the  7  basic  tools  and  so  on 

Tools  typically  associated  with  Lean 

•  value  stream  mapping* 

•  cycle  time  and  throughput  analysis,  Little’s  Law* 

•  process  dynamics  analysis* 

•  pull  systems  (kanban) 

•  setup  reduction  methods 

•  mistake-proofing  (poka  yoke) 

•  5S  Housekeeping  (sort,  set  in  order,  shine,  standardize, 
sustain),  and 

•  total  productive  maintenance  (i.e.,  optimizing  scheduled 
downtime 
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CMMI 

Process 

Areas 

(for  reference) 


Category 

Process  Areas 

Process 

Management 

Organizational  Process  Focus  (OPF) 
Organizational  Process  Definition  (OPD) 
Organizational  Training  (OT) 

Organizational  Process  Performance  (OPP) 
Organizational  Innovation  and  Deployment  (OID) 

Project 

Management 

Project  Planning  (PP) 

Project  Monitoring  and  Control  (PMC) 

Supplier  Agreement  Management  (SAM) 
Integrated  Project  Management 

Risk  Management  (RSKM( 

Quantitative  Project  Management  (QPM) 

Engineering 

Requirements  Management  (REQM) 

Requirements  Development  (REQD) 

Technical  Solution  (TS) 

Product  Integration  (PI) 

Verification  (VER) 

Validation  (VAL) 

Support 

Configuration  Management  (CM) 

Process  and  Product  Quality  Assurance  (PPQA) 
Measurement  and  Analysis  (MA) 

Causal  Analysis  and  Resolution  (CAR) 

Decision  Analysis  and  Resolution  (DAR) 
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Outline 

Value  Proposition 

•  Our  (Your)  Multi-Initiative  Reality 
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©  •  Six  Sigma  as  a  Strategic  Enabler 
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•  Strategies 
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Identifying  Your  Solution 
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•  Emerging  Research 

•  Existing  best  practices  to  leverage  today 
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Six  Sigma  as  Strategic  Enabler 

The  SEI  conducted  a  research  project  to  explore  the  feasibility  of 
Six  Sigma  as  a  transition  enabler  for  software  and  systems 
engineering  best  practices. 

Hypothesis 

•  Six  Sigma  used  in  combination  with  other  software,  systems, 
and  IT  improvement  practices  results  in 

-  better  selections  of  improvement  practices  and  projects 

-  accelerated  implementation  of  selected  improvements 

-  more  effective  implementation 

-  more  valid  measurements  of  results  and  success  from  use 
of  the  technology 


Achieving  process  improvement...  better,  faster,  cheaper. 
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Primary  Conclusions 


Six  Sigma  is  feasible  as  an  enabler  of  the  adoption  of  software, 
systems,  and  IT  improvement  models  and  practices  (a.k.a., 
“improvement  technologies”). 


The  CMMI  community  is  more  advanced  in  their  joint  use  of 
CMMI  &  Six  Sigma  than  originally  presumed. 


Noting  that,  for  organizations  studied,  Six  Sigma  adoption  & 
deployment 

•  was  frequently  decided  upon  at  the  enterprise  level,  with 
software,  systems,  and  IT  organizations  following  suit 

•  was  driven  by  senior  management’s  previous  experience 
and/or  a  burning  business  platform 

•  was  consistently  comprehensive 

•  was  consistently  considered  part  of  their  “competitive  edge” 
with  respect  to  software  and  systems 


Because  of  the  proprietary  nature  of  our  data  and  the  non-disclosure  agreements  in 
place,  the  results  in  this  public  briefing  are  intentionally  at  a  high  level. 

[IR&D  04] 
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Selected  Supporting  Findings 

Six  Sigma  helps  integrate  multiple  improvement  approaches  to 
create  a  seamless,  single  solution. 

Rollouts  of  process  improvement  by  Six  Sigma  adopters  are 
mission-focused,  flexible,  and  adaptive  to  changing 
organizational  and  technical  situations. 

Six  Sigma  is  frequently  used  as  a  mechanism  to  help 
sustain — and  sometimes  improve — performance  in  the 
midst  of  reorganizations  and  organizational  acquisitions. 

Six  Sigma  adopters  have  a  high  comfort  level  with 
a  variety  of  measurement  and  analysis  methods. 

•  adopters  report  quantitative  performance  benefits  using 
measures  they  know  are  meaningful  for  their  organizations 
and  clients.  For  instance,  ROI  of  3:1  and  higher,  reduced 
security  risk,  and  better  cost  containment 

[IR&D  04] 
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CMMI-Specific  Findings 


Six  Sigma  is  effectively  used  at  all  maturity  levels. 


Participants  assert  that  the  frameworks  and  toolkits  of  Six  Sigma 
exemplify  what  CMMI  high  maturity  requires. 


Case  study  organizations  do  not  explicitly  use  Six  Sigma  to  drive 
decisions  about  CMMI  representation,  domain,  variant,  and 
process-area  implementation  order.  However,  participants  agree 
that  this  is  possible  and  practical. 


CMMI-based  organizational  assets  enable  Six  Sigma  project- 
based  learnings  to  be  shared  across  software  and  systems 
organizations,  enabling  a  more  effective  institutionalization  of  Six 
Sigma. 


[IR&D  04] 
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IT-Specific  Findings 

High  IT  performers  (development,  deployment,  and  operations) 
are  realizing  the  same  benefits  of  integrated  process  solutions 
and  measurable  results. 

•  However,  they  are  using  the  technologies  and  practices 
specific  to  their  domain  (ITIL,  COBIT,  and  sometimes  CMMI). 


CMMI-specific  findings  apply  to  IT  organizations  who  have 
chosen  to  use  CMMI. 


[IR&D  04] 
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Architecture-Specific  Findings 

Multiple  organizations  are  pursuing  the  joint  use  of  Six  Sigma, 
CMMI,  and  ATAM,  noting  the  strong  connections  among  DFSS, 
ATAM,  and  the  engineering  process  areas  of  CMMI. 

Many  survey  respondents  are  in  organizations  currently 
implementing  both  CMMI  and  Six  Sigma  DMAIC,  and  many  are 
in  organizations  progressing  with  DFSS. 

•  Of  those  implementing  DFSS,  the  majority  are  at  least 
progressing  with  CMMI  (but  some  are  not  using  CMMI  at  all), 
and  none  are  using  ATAM* 


There  is  much  untapped  potential  here! 

ATAM  =  Architecture  Tradeoff  Analysis  Method 
*At  the  time  this  research  project  was  conducted 
[IR&D  04] 
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Why  Six  Sigma  needs  CMM1 1 

CMMI  offers  mechanisms  to  institutionalize  practices  for  long 
term  organizational  adoption 

CMMI  offers  a  complete,  mature  and  proven  mechanism/process 
to  appraise  project  and  organizational  implementation 

CMMI  offers  organizational  learning  practices 

CMMI  and  Team  Software  Process  offer  strong  teaming 
practices  and  processes  within  a  Software  and  Systems  context 

CMMI  offers  a  formalized  process  approach  to  overall  decision¬ 
making  within  projects  and  the  organization  via  the  DAR  Process 
Area 
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Why  Six  Sigma  needs  CMMI 2 

CMMI  is  uniquely  both  an  improvement  and  product 
development  model  that  helps  integrate  Six  Sigma  into  a  client’s 
existing  product  development  lifecycle  model 

The  CMMI  and  TSP  provide  a  rich  context  of  information  to  help 
target  Six  Sigma  solutions  (e.g.  CMMI  offers  domain  context  and 
both  continuous  and  staged  representations) 

CMMI  offers  a  complete  discussion  of  stakeholder  involvement 
within  relevant  Process  Areas 

CMMI  Process  Areas  (QPM,  OPP,  OID)  add  deeper  dimensions 
to  concept  of  Six  Sigma  critical  parameter  management 
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Why  Six  Sigma  needs  CMMI 3 

CMMI  investments  produce  well-placed,  trained 
software/systems  change  agents  and  appraisers  who  should  be 
great  candidates  as  Software  Six  Sigma  Black  Belts 

Existing  CMMI  initiatives  and  investment  can  be  significantly 
leveraged  for  deployment  of  Six  Sigma  within  Software/Systems 
organizations  (economies  of  scale) 

Existing  CMMI  implementations  provide  a  language  with 
stakeholders  that  can  be  leveraged  to  explain  Six  Sigma 
concepts 
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Value  Proposition 

•  Our  (Your)  Multi-Initiative  Reality 

•  Six  Sigma  Fundamentals 

•  Six  Sigma  as  a  Strategic  Enabler 

Multi-Initiative  Implementation 

•  Case  Profiles 

•  Strategies 

•  Tactical  Connections 

Identifying  Your  Solution 

•  Process 

•  Emerging  Research 

•  Existing  best  practices  to  leverage  today 

Summary 
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Profile:  Lockheed  Martin  Integrated 
Systems  &  Solutions  (IS&S) 

BACKGROUND,  OVERVIEW 

Current  organizational  context 

•  Four  primary  geographic  regions  (40+  sites) 

•  Seven  Lines  of  Business 

•  15,000  employees 

•  Standard  Operating  Process  (Program  Process  Standard)  across  all 
programs 

•  Maintain  the  CMMI  Maturity  Level  5  through  mergers  and  acquisitions 
Fifteen  years  ago.... 

•  Executive  VP  with  a  “passion  for  process” 

•  “Software  Engineering  &  Management  Manual” 

•  DoD  requirements  to  be  “Level  3”  (currently  SW  CMM  Level  2) 

•  Separate  implementations  of  CMM,  SE  CMM,  ISO  9000 
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IS&S  Strategy 


Strategy:  Program  Process  Standard  (PPS) 

•  minimum  mandatory  set  of  development  processes 

•  updated  using  industry  standards  in  which  certifications  were  desired 


Establishing  a  Process  Architecture 

•  New  organizational  structure 

•  The  “Required  Development  Process”  (RDP) 

Lean  (&  Six  Sigma)  en  route  to  high  maturity 

•  RDP  expanded  to  full-fledged  PPS 

•  Measurement  infrastructure  (PSM;  DMAIC  implicit) 

•  New  process  methods  such  as  architecture  based  design 

•  New  Corporate  Initiative:  Lean 

-  EnabedbyCMM 

-  Accelerated  new  CMMI  PA  implementation  (lo  &  hi  mat.) 

-  Addressed  biz  processes  outside  of  CMMI 

-  Applied  to  appraisals 

Growth  &  Sustainment 

•  CMMI 

•  Lean  applied  to  appraisals 
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K  H  E  E  D  MARTIN 


IS&S  Process  Architecture 


Operational 
Analysis  _ 


Capability 
.Analysis  / 


Procurement 


Sop/System1 

Definition 


Operations 


System 

Development 


Transition 


/  System 1 
Integratio 


Mission  Req’t  &  Arch  Def 
SoS  Req’t  &  Arch  Def 
System  Req’ts  Analysis 
Architecture-Based  Design 
Detailed  Design 
Code  &  Unit  Test 
Hardware  Assy  &  Unit  Ver 
Product  Integration  &Ver 
System  Integration  &Ver 
Delivery  &  Installation 
SoS  Integration  &Ver 
Transition  to  Operations 
Operations  &  Maintenance 


Program  Mgt  &  Control 
Contract  Management 
Subcontract  Management 
Program  Finance 
Supplier  Management 
Quality 

Risk/Opportunity  Mgt 
Quantitative  Management 
Configuration/Data  Mgt 
Decision  Analysis 


Integrated  Logistics  Support  (ILS) 
SoS  Readiness 
Analysis  &  Modeling 
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IS&S  PPS 


L  O  C 


K  H  E  E  D  MARTIN 


Management  and  Control 


Program  Management  and  Control 


Program  Finance 


Risk/Opportunity  Management 


Program  Implementation 

Mission 
Analysis 


i 


Hardware 

Requirements 

Analysis 


System 

Requirements 

Analysis 


Architecture 

Design 


a 


Software 

Requirements 

Analysis 


Subcontract  Management 


Supplier  Management 


Quantitative  Management 


Hardware 

Design 


Software 

Design 


Contract  Management 


Quality 


Configuration/Data  Management  (CM/DM) 


Decision  Analysis 


Product  Assembly 
and 

Unit  Verification  Test 


System 

Integration  and 
Verification 


Product 
Integration  and 
Verification 


Deployment 


Code  and 
Unit  Test 


Product 

Support 


Integrated  Logistics  Support  (ILS)  Human  Engineering,  Reliability,  Maintainability,  and  System  Safety  (HERMS) 
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LOCKHEED  MARTI  N  x 


IS&S  PPS  Mappings 


'Six  Sigma  links: 


Level  2  Measurement  &  Analysis  PA,  Level  4/5  PAs 
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IS&S  Timeline 


LOCKHEED  MARTI  N  . 


ENT 


MISSION  SUCCESS 
2002 

PROGRAM  PROCESS 
STANDARD 

1996 


ENGINEERING 
PROCEDURES  (EP) 

1989 


SOFTWARE  ENGINEERING 
AND  MANAGEMENT  (SEAM) 
MANUAL 

1978 


IMPROVING  EVERY  STEP  OF  THE  WAY 


1995  LMC 
1993  MMC 
1978  GEA 
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IS&S  Results  &  Benefits 


Benefits  of  chosen  strategy 

•  Project  example:  30%  cycle  time  reduction  -  idea  to  proposal 

•  Robust;  easy  to  build  in  new  models,  practices 

•  Distinct  contribution  of  any  individual  model  difficult  to  extract 

-  all  worked  together  to  achieve  performance  shown  on  next 
slide 

Success  Factors 

•  Built  the  vision  while  at  “low  maturity” 

•  Sr.  Management  sponsorship 

•  Key  personnel  with  needed  systems  and  strategic  outlooks  as 
well  as  breadth  of  experience 
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IS&S  Results  &  Benefits 


IS&S  Journey  to  CMMI  L5 


^  Software  Productivity 

Up  52% 

Potential  Additional 
Award  Fee  Achieved 

52.5% 

SW  Development  Cost 

Down  23% 

-►  Wrap  Rate 

_ 

Down  5.5% 

**  Defect  Find  /  Fix  Cost 

Down  21  % 

_ Process  Maturity _ 

S/W  productivity  increased  52% 
over  baseline  average  capability 


S/W  cost  decreased  23%  in 
Constant  2004  dollars 


Program  Performance 

•  95.5%  of  programs  > 
$50M  have  no  serious 
problems. 

•  Improved  Award  Fee 
performance 
continues 


Defect  Find  /  Fix  cost 
down  by  21% 


I  i 


Drive  World  Class  Performance  I  Competitiveness 
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Motorola 

The  CM  Ml  adoption  decision:  Will  it  benefit  existing  Six  Sigma  initiatives? 
Executive  sponsorship  and  engagement 

•  Benchmarked  with  execs  from  a  successful  company:  to  witness  the 
benefits  first  hand 

•  Execs  gave  the  sales  pitch  --  their  personal  leadership  sold  it 

•  Established  upward  mentoring:  MBB  coach  &  CMMI  expert  for  each  exec 

Deployment  -  Leveraging  executive  “pull” 

•  Execs  controlled  adoption  schedule,  to  meet  critical  business  needs 

•  Modified  the  reward  and  recognition  structure 

•  “Rising  star”  program  for  both  technical  and  management  tracks 

•  Training  began  at  the  top  and  worked  its  way  down 

Execution  -  Speaking  the  language  of  executives  and  the  business 

•  Calculated  costs  &  benefits  of  all  proposals;  listed  the  intangibles 

•  Risk  reduction:  Start  small,  pilot,  and  build  on  successes 


[Siviy-Hefner  06] 
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Exercise 

Purpose:  Share  &  Prioritize  Ideas 

Step  1:  Please  write  down  on  a  piece  of  paper: 

•  “The  Biggest  Obstacle  in  my  organization  to 
implementing  what  I  have  heard  in  this  tutorial  is  _ 

Steps  2+  will  be  described  after  Step  1  is  completed 
Results  will  be  shared  after  break 
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BREAK 


After  break: 

Strategic  &  Tactical  Connections 

Later  today: 

Considerations  for  YOUR  multi-model  approach 

If  you  would  like  copies  of  our  final  slides, 
add  your  name  to  our  signup  sheet,  or 
send  an  email  to  Debra  Morrison,  dtm@sei.cmu.edu. 

•  Put  “SEPG  Tutorial”  in  the  subject  line. 
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Outline 


Value  Proposition 

•  Our  (Your)  Multi-Initiative  Reality 

•  Six  Sigma  Fundamentals 

•  Six  Sigma  as  a  Strategic  Enabler 

Multi-Initiative  Implementation 

•  Case  Profiles 
'  •  Strategies 

.  •  Tactical  Connections 

Identifying  Your  Solution 

•  Process 

•  Emerging  Research 

•  Existing  best  practices  to  leverage  today 

Summary 
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Integrating  Initiatives:  Field  Notes  1 

(public  domain  literature) 

Northrop  Grumman  Mission  Systems 

•  “Northrop  Grumman  was  able  to  accelerate  achievement  of 
Levels  4  and  5  using  Six  Sigma” 

•  “Six  Sigma  is  an  enabler  for  measuring  the  value  of  specific 
improvements” 

•  “Six  Sigma  provides  a  way  to  connect  process  improvement 
and  business  value” 

•  “Six  Sigma  projects  can  help  focus  and  measure  CMMI-driven 
process  improvements” 

•  “..conducting  Level  5  SCAMPI  appraisals  in  5-6  days... 
significant  cost  savings” 


[Facemire  04],  [Hefner  04] 

Presentations  available  at  http://seir.sei.cmu.edu 
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Integrating  Initiatives:  Field  Notes  2 

(public  domain  literature) 

Tata  Consultancy  Services 

•  “...a  development  Center....  used  SW-CMM  and  Six  Sigma  concepts  to 
reduce  its  in-process  failure  costs  from  5  to  1  percent....” 


Wipro 

•  Enterprise  integrated  system,  includes  ISO  9001,  CMM,  P-CMM, 
TL9000,  British  Standard  7799,  Six  Sigma 

-  “...Six  Sigma  methodologies  brought  in  quantitative  understanding, 
cost  savings,  and  performance  improvement  towards  product 
quality.” 

-  “Six  Sigma...  brought  about  a  focused  customer-centric  and  data- 
driven  paradigm  to  product  and  process  quality...” 

•  'Defects  are  steadily  falling  in  cylinder  manufacturing,'  Bagchi  says.  'In 
the  fixed  deposits  area  of  our  financial  services  division,  we  have  a 
process  in  place  to  eliminate  non-value  adding  steps  and  mistake-proof 
the  system.  We're  projecting  a  30  per  cent  cycle  time  reduction  in  our 
computer  business.  The  estimated  short-term  gains  will  be  six  to  eight 
times  the  total  investment  we  put  into  six  sigma’ 

[Keeni  03],  [Wipro  04],  [Wipro  01] 
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Strategic  Approaches 

Observed  Patterns  in  the  Joint  Implementation  of  CMMI  and  Six  Sigma 

Implement  CMMI  process  areas  as  “Six  Sigma  projects” 

Use  Six  Sigma  as  the  tactical  engine  for  high  capability  and  high 
maturity. 

Apply  Six  Sigma  to  improve  or  optimize  an  organization’s 
improvement  strategy  and  processes. 

Integrate  CMMI,  Six  Sigma,  and  other  improvement 
models/references  into  a  process  standard  to  be  used  by  every 
project  throughout  its  life  cycle 


[Siviy  05-1] 
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Specific  DMAIC-CMMI  Relationships  1 

Overall 

•  DMAIC:  a  problem  solving  approach 

•  CMMI:  a  process  &  measurement  deployment  approach 

PAs  that  align  with  DMAIC  include  the  following: 

•  MA,  GPs 

•  QPM,  CAR,  OID  (either  “continuous”  or  high-maturity  view) 

A  DMAIC  project  may  leverage  these  existing  processes: 

•  PP,  PMC,  IPM 

•  OPP  for  organization  level  execution,  mgmt,  oversight 

PAs  through  which  DMAIC  may  be  incorporated  into 
organizational  process  definition  include  the  following: 

•  OPF,  OPD 


[Siviy  05-1] 
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Specific  DMAIC-CMMI  Relationships 


PAs  “eligible”  for  DMAIC-based  improvement 

•  all 

PAs  with  links  to  the  analytical  toolkit  include 

•  Decision  Analysis  &  Resolution 

-  e.g.,  concept  selection  methods,  such  as  Pugh’s 

•  Risk  Management 

-  e.g.,  Failure  Modes  &  Effects  Analysis  (FMEA) 

•  Technical  Solution 

-  e.g.,  Design  FMEA,  Pugh’s 


[Siviy  05-1] 
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DFSS  &  CMMI 

How  DFSS  Enables  CMMI  Rigor 

As  organizations  transition  from  the  SEI  CMM  to  the  SEI 
CMMI  model,  they  will  find  that  DFSS  offers  methods  and 
tools  for  all  new  and  emphasized  processes. 

Although  not  shown,  Six  Sigma  DMAIC  offers  excellent 
support  in  the  areas  that  DFSS  may  show  less  than 
complete  coverage. 

Together,  Six  Sigma  DMAIC  and  DFSS  provide  the  means 
to  accomplish  a  multi-model  implementation  for  process 
improvement! 
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Specific  DFSS-CMMI 
Relationships 


\  cri 
\dis 


Example  using,  IPM 

For  Integrated  Project 
Management,  SSPD  includes: 

■  Organizational  process  of 
tools,  tasks  and  deliverables  for 
managing  the  project  and 
involving  relevant  stakeholders 

■  Estimation  and  planning  using 
a  measurement  repository  of 
quantitative  baselines  with 
confidence  intervals 

■  Scorecards 

■  Gate-keeping  Reviews  with 
relevant  stakeholders 

■  Critical  dependencies  and 
critical  path  measured  with  risk 
distributions 


CMMI  Process  Area 

CMM 

Satisfy 

DFSS 

Satisfy 

Organizational  Process  Focus 

Organizational  Process  Definition 

Organizational  Training 

dd 

Organizational  Process  Performance 

Organizational  Innovation  and  Deployment 

tq 

Project  Planning 

Project  Monitoring  and  Control 

Supplier  Agreement  Management 

Integrated  Project  Management 

Risk  Management 

Integrated  Teaming 

Integrated  Supplier  Management 

Quantitative  Project  Management 

Requirements  Management 

Requirements  Development 

Technical  Solution 

Product  Integration 

Verification 

Validation 

Configuration  Management 

Process  and  Product  Quality  Assurance 

Measurement  and  Analysis 

Decision  Analysis  and  Resolution 

hd 

Organizational  Environment  for  Integration 

tq 

Causal  Analysis  and  Resolution 

□ 

NOTE:  An  example  of  one  anonymous  organization  mapping  their  CMM  implementation  and  DFSS  tools  into  the  CMMI  Process 
Areas  that  were  being  newly-adopted. 
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Two  basic  relationships  between  the  two: 

•  Process  Definition 

•  Process  Improvement 

Process  Definition 

•  OPF,  OPD  can  be  implemented  using  Lean  techniques  and 
methods 

•  All  PAs  can  use  Lean  to  assist  in  documenting  the  process 
most  efficiently 

Process  Improvement 

•  All  PAs  can  use  Lean  to  improve  (GP3.2) 

•  CAR,  OID  specifically  will  find  Lean  the  method  of  choice 

•  QPM  can  also  use  Lean  in  their  process  modeling 
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CMMI  Staged  and  Six  Sigma 


•  Organization-wide  6 a  improvements  and  control 

•  Correlation  between  key  process  areas  &  6a  methods 

•  60  used  within  CMM  efforts 


Optimizing 


Process 

improvement 


0  •  Infrastructure  in  place 
•  Defined  processes  feed  6a 

I - 

6a  philosophy  &  method  focus 
6a  “drilldown”  drives  local 


Quantitatively 
Managed 


Process  measured 
and  controlled 


Defined 


Process  characterized  for  the 
organization  and  is  proactive 


Process  characterized  for  projects  and 
is  often  reactive 


(but  threaded)  improvements  f| 


6a  may  drive  toward  and 
accelerate  CMMI  solution 


Process  unpredictable  and  poorly  controlled 


Six  Sigma  is  enterprise  wide. 

Six  Sigma  addresses  product  and  process. 

Six  Sigma  focuses  on  “critical  to  quality”  factors. 
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Six  Sigma  and  CMMI  Continuous 

One  possible  approach: 

•  Achieve  high  capability  in  PAs  that  build  Six  Sigma 
skills,  such  as  MA,  QPM,  CAR,  OPP 

•  Use  capability  to  help  prioritize  remaining  PAs 


Remaining  PAs  ordered  by  business  factors,  improvement  opportunity,  etc.  which  are 
better  understood  using  foundational  capabilities.  CMMI  Staged  groupings  and  DMAIC 
vs.  DMADV  are  also  factors  that  may  drive  the  remaining  order.  [Vickroy  03] 
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Example  M&A  Process 


(§> 


Select 
Business  Goal 


ective 


ce  Thresholds 


i 


No  “Issues” 


Identified 

Thresholds 


•Project  Performan 
•Measures  Quality 
•SPI  Implementation 


Gather 

Data 


Improvements 


Draft  Improvement 
•Snapshot  (1st  Iteration  ->  Baseline)  Goal  (SMART)  or 
•Issues  (Validity  of  data,  Quality  of  Identify  focus  area 
Data,  Variance  (performance) 


Identify 

Gather  Data/Analyze  Data 

Perform  Causal 

Prioritize 

Identify 

Possible 

Analysis 

w 

^ ^Actual 

- w 

Potential 

Causes 

o. «  nVauses 

Solutions 

(Brainstorm) 

v _ k 

1st  Iteration  ->  Final  Goal 


Goal  Refinement 


Develop 

rr\ 

Implement 

Action  Plan 

Improvement 

©  2007  by  Carnegie  Mellon  University 


page  55 


Carnegie  Mellon 

Software  Engineering  Institute 

Outline 

Value  Proposition 

•  Our  (Your)  Multi-Initiative  Reality 

•  Six  Sigma  Fundamentals 

•  Six  Sigma  as  a  Strategic  Enabler 

Multi-Initiative  Implementation 

•  Case  Profiles 

•  Strategies 

•  Tactical  Connections 

Identifying  Your  Solution 

•  Process 

•  Emerging  Research 

•  Existing  best  practices  to  leverage  today 

Summary 


©  2007  by  Carnegie  Mellon  University 


page  56 


Carnegie  Mellon 

Software  Engineering  Institute 

Determining  YOUR  Approach 

Key  Questions 

•  What  is  your  mission?  What  are  your  goals? 

•  Are  you  achieving  your  goals?  What  stands  in  your  way? 

•  What  process  features  are  needed  to  support  your  goals? 

What  technologies  provide  or  enable  these  features? 

•  What  is  the  design  of  a  cohesive  (integrated),  internal 
standard  process  that  is 

rapidly  and  effectively  deployed 
easily  updated 

compliant  to  models  of  choice 

Considerations  &  Success  Factors 

•  Process  architecture  &  process  architects 

•  Technology  and  organization  readiness 

•  Technology  adoption  scenarios  and  strategy  patterns 

•  Measurement  as  integrating  platform 

°  [Siviy  05-2] 
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Determining  YOUR  Approach 

First  Remember:  Everything  is  a  Process! 


Technology  R&D  Organizations 


Mgrs 


Organization’s  Process  Group 


Establish 
Business 
mission,  drivers 


-> 


4Select 
Technology 


Implement 


dev. 


trans. 


Evaluate 

impact 


-A- 


Biz  Results, 

Compliance 

Ratings 


Jz . Project  or  Operations. Teanis 


Implement/Integrate  tech. 


_ JL _ 

Est.  projec 

-> 

mission 

Execute  work 


Evaluate 
results 


->Proj 

Results, 


[Siviy  04] 
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Emerging  Research: 

An  Initial  Reasoning  Framework 


Mgrs 

Establish 
Business 
mission,  drivers 

Measure  &  Analyze 

•  Mission/strategy 
planning 

•  “Mission  Translation” 
via  GDM  and  6S 
techniques 

•  Project  portfolio 
management 


Org.  Process  Group,  incl  “process  architects/engineers” 


Strategy  & 

Tech 

Selection 

Implement 

Evaluate 

impact 

- > 

^^^trans. 

dev.^^^ 

- > 

Measure  &  Analyze 

•  Strategy/design  patterns  *  Process  design/arch  and 

for  model  integration  validation  methods, 

•  Decision  science  *  Transition  science 


Cross-process  practices 

•  Organizational  Change  Mgmt,  including  communications  in  all  directions 

•  Measurement  and  Analysis  methods  -  both  for  “strategic  integration”  and  tactical  value 
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Mission  Translation 


Why? 

i 


How? 


control  charts  (c-charts) 
scatter  plots  4 - 


control  charts  (x,  mr) 
scatter  plots 


Progress 

Indicators 


SPI  Task 
Plans 
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While  the  re-alignment  may  not  change  the  specific  improvement 
activities,  it  will  positively  affect  “change  management ”  efforts. 
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Project  Portfolio  Management 

Different  project  types 

•  Enabling,  for  example 

-  Establish  measurement  infrastructure 

•  Problem  solving,  for  example 

-  variance  reduction,  cycle  time  reduction,  and  so  forth 

-  Reduce  the  total  variance  by  decreasing  the  variance  of 
the  top  3  internal  causes  by  50%  in  1  year. 

-  Reduce  the  impact  of  external  causes  by  50%. 

•  Design,  including 

-  Product  design 

-  Process  design 


Alignment,  prioritization  guided  by  “mission  translation” 
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Project  Portfolio  Management  Example 
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Sr.  Mgmt  scorecard  ; 
Middle  Mgmt  dashboard 


Success 

Criteria 


t 


Status  of  Software  Engineering  Processes 


Sr.  Mgmt  dashboard 

•  quality  trends 

•  selected  project  EV  data 

Middle  Mgmt  dashboarc 

•  system  documentation  and 
testing 


t 


=n= 

|  ■  .  n  ,  n  ,  I M  M  \wn,< 


#y&  >v/  .<// 


Analysis  Indicators 

Reqts  completeness  - 
original,  at  inspection, 
approved  (for  contract  1 ) 


Stratec 

reference  models:  CMMI,  SA  CMM7 
IEEE/ISO  12207 

Leverage  CMMI  capabilities  built  in 
engineering:  MA,  REQM,  RD,  CAR 

Aim  for  CMMI  capability  in  selected  PAs: 
SAM,  DAR,  RSK,  PP/PMC,  CM,  PPQA 

Reference  all  SA-CMM  Level  2  kPAs, 
Dting  overlaps  with  CMMI 


Tasks  to  Accomplish  goal 

•  Implement  requirements  management 
process 

•  Tailor  existing  project  monitoring  processes 
for  acquisition  managers 


Success  Indicators 

process  owners,  training, 

CM,  and  documentation 
(future:  procedural  adherence) 


Middle  Mgmt  Dashboard 

•  selected  SPI  plan  EV  data 
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LOCKHEED  M  A  R  T  I  f 


Lockheed  Martin  IS&S  Proj.  Selection 


Process  Improvement  Recommendation  (PIR) 

•  Process  Owner  evaluates,  determines  feasibility,  level  of 
institutionalization  and  need  for  pilot 

E-Transformation 

•  all  business  processes  that  affect  overhead  are  applicable 

•  select  based  on  ROI  and  relevance  to  business 

-  Requires  firm  understanding  of  the  “before”  state 

-  “Just  do  it”  Projects 

-  Kaizen  event  with  rollout  plan 

•  required  use  of  Six  Sigma  methods/tools  for  optimization 

Technology  Change  Management  Working  Group  (TCMWG) 

•  once  a  year  call  for  ideas,  incl  PIR  pilots 

•  “before  state”  used  to  measure  impact  of  the  “after”  state 

•  required  use  of  Six  Sigma  methods,  modeling  for  optimization 
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Motorola  Project  Selection 

Big  Y  to  Vital  x  project  trees  ensured  systems  thinking  of 
improvement  needs  driven  by  business  goals 

Significantly  reduced  sub-optimization  within  individual 
disciplines  and  shifted  focus  to  the  overall  business 

Improvement  projects  received  proper  management 
sponsorship  and  resources  because  of  Vital  x  nature 

Performance  highlighted  to  entire  organization  thereby 
motivating  and  enhancing  team  achievements! 
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Strategy/Design  Patterns 

Enterprise  /  non-domain  specific  domain 

/ 

/  specific 


Governance 


EFQM 


Organizational 

Infrastructure, 

readiness 

(incl  biz  practices,  engr  practices, 
change/improvement  practices) 


CMMI 


Tactical 

(procedural  -  both  for 
improvement  tasks  and 
for  engrg  tasks) 


Lean  FDA/51  OK 

Six  Sigma  SOX 

/ 

/ 

- iOBIT  IS09I  00- 

/ 

/ 

/ 

P-CMM  ISO12207 

/ 

/ 

/ 

SCOR  ITIL  SWEBOK 

/ 

/ 

/ 

-  -  iJlM  PSM - 

/ 

6S/DMAIC  IDEAL 

/ 

/ 

6S/DFSS  TSP 

/ 

/ 

/ 

RUP 


Agile 
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LOCKHEED  MARTIN 


LMCO  IS&S  Strategy/Design  Pattern 


Governance 


Enterprise  /  non-domain  specific 

/ 


SOX  Lean 
Six  Sigma 


domain 

specific 


Organizational 

Infrastructure, 

readiness 

(incl  biz  practices,  engr  practices, 
change/improvement  practices) 


IS09000 

P-CMM 

AS9100 


CMMI  I  S0 12207 

JSTD-01 6  IS014000 

IEEU3°  IS020000 
IEEE  1471  |S0  17666 


IEEE  829 


ISO/I  EC  15288 


Tactical 

(procedural  -  both  for 
improvement  tasks  and  for 
engrg  tasks) 


6S/DMAIC 


Lean /Six  / 

/ 

Sigma 


LM  IEP 


IDEAL 

PPS 

RUP 


PSM 


Agile 
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Process  Architecture 

“Architecting”  software  processes  is  an  area  of  emerging  research 

Best  Practices  to  leverage 

•  Process  mapping 

•  DFSS / LDFSS 

•  ETVX 

•  CMMI  Generic  Practices 

•  CMMI,  ISO  12207  and  other  model  content 

•  EPIC’s  “validated  architecture” 

•  UML 


EPIC  =  Evolutionary  Process  for  Integrating  COTS-Based  Systems 
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Effective  Transition  Planning 

“Transition”  is  indicated  by  each  of  the  following: 

•  maturation,  introduction,  adoption,  implementation, 
dissemination,  rollout,  deployment,  or  fielding 

Features  of  effective  transition  planning  include: 

•  precision  about  the  problem,  clarity  about  the  solution 

•  transition  goals  and  a  strategy  to  achieve  them 

•  definition  of  all  adopters  and  stakeholders  and  deliberate 
design  of  interactions  among  them 

•  complete  set  of  transition  mechanisms:  a  whole  product 

•  risk  management 

•  either  a  documented  plan  or  extraordinary  leadership 
throughout  the  transition 

[Forrester],  [Schon],  [Gruber] 
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“Whole  Product” 

A  Feature  of  Effective  Transition  Planning 


Economies  of  scale  are 
needed  in  training. 

A  holistic,  “connected” 
approach  is  needed  in 
training. 

Leaving  students  to  their 
own  devices  to  make 
connections  can  be  risky 
and/or  time-consuming. 


[Moore] 
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Integrated  Training  Solutions 


Integrated  training  solutions  underway: 


DFSS  training  that  includes  awareness  sessions  of 
relevant  technologies 

-  SEI’s  Product  Line  Practices,  ATAM,  CMMI 
engineering  PAs 

DFSS  training  that  leverages  ATAM 

DMAIC  training  that  references  PSP-based 
instrumented  processes 


Strategic 

Emphasis 


Tactical 

Emphasis 


SEI’s  approach  uses  measurement  &  analysis  as  an  integrator. 
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Outline 

Value  Proposition 

•  Our  (Your)  Multi-Initiative  Reality 

•  Six  Sigma  Fundamentals 

•  Six  Sigma  as  a  Strategic  Enabler 

Multi-Initiative  Implementation 

•  Case  Profiles 

•  Strategies 

•  Tactical  Connections 

Identifying  Your  Solution 

•  Process 

•  Emerging  Research 

•  Existing  best  practices  to  leverage  today 

Summary 
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Value  Proposition 

SEI  special  project 

•  Six  Sigma  as  an  enabler  of 
domain-specific  initiatives 

Primary  conclusions,  supported  by_  data 

•  Enabler 

•  Accelerator 

•  Synergistic  and  complementary 

•  Effective  at  all  CM  Ml  maturity  levels 


Key  supporting  findings 

•  Mission  focus 

•  “Seamless”  model  integration 

•  Engineering  process  architecture  &  design 

•  Robustness  to  organizational  change 

•  High  comfort  with  measurement  &  analysis 

•  Culture  Change 
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Strategies  &  Tactics 

Focus  on  mission  success 

•  Supported  by  performance  driven  improvement 

Process  improvement  itself  is  a  process 

•  Leverage  best  practices  and  emerging  research  for 
design,  transition  and  measurement 

Implementation  Strategies 

•  CMMI  process  areas  as  “Lean  /  Six  Sigma  projects” 

•  Lean/Six  Sigma  as  tactical  engine  for  high  maturity 

•  Integrated  process  standard 

Design  an  integrated,  yet  simple,  process  architecture 

Everything  should  be  made  as  simple  as  possible,  but  not  one  bit  simpler 

-  Albert  Einstein 
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Contact  Information 

Jeannine  Siviy 

412.268.7994 

imsiviv@sei.cnnu.edu 

M.  Lynn  Penn 
610.354.1188 
mary.lynn.penn@lmco.com 

Robert  Stoddard 

412.268.1121 

rws@sei.cmu.edu 


©  2007  by  Carnegie  Mellon  University 


page  76 


Carnegie  Mellon 

Software  Engineering  Institute 

References 


[Beckhard] 

Beckhard,  R.  &  Harris,  R.  Organizational  Transitions.  Addison-Wesley, 

[BPD] 

Reading,  MA,  1987. 

Process  Maturity  /  Capability  Maturity, 

http://www.betterproductdesiqn.net/maturitv.htm,  a  resource  site  for  the 
Good  Design  Practice  program,  a  joint  initiative  between  the  Institute  for 
Manufacturing  and  the  Engineering  Design  Centre  at  the  University  of 
Cambridge,  and  the  Department  of  Industrial  Design  Engineering  at  the 
Royal  College  of  Art  (RCA)  in  London. 

[Forrester] 

[Gruber] 

Forrester,  Eileen,  Transition  Basics 

William  H.  Gruber  and  Donald  G.  Marquis,  Eds.,  Factors  in  the  Transfer  of 
Technology,  1965. 

[Hallowell/Siviy  05] 

Hallowell,  Dave  and  Jeannine  Siviy,  Bridging  the  Gap  between  CMMI  and 
Six  Sigma  Training,  SEPG  2005,  slides  available  at 
http://www.sei.cmu.edu/sema/presentations.html: 

[Hefner  04] 

Hefner,  Rick,  Accelerating  CMMI  Adoption  Using  Six  Sigma,  CMMI  Users 
Group,  2004 

[Keeni] 

Keeni,  Gargi  and  Mala  Murugappan,  Blending  CMM  and  Six  Sigma  to  Meet 
Business  Needs,  IEEE  Software,  March  2003 

[Moore] 

Geoffrey  Moore,  Crossing  the  Chasm:  Marketing  and  Selling  Technology 
Products  to  Mainstream  Customers.  Harper  Business.  1991 . 

[MPDI] 

SEI  Course,  Measuring  for  Performance  Driven  Improvement  1,  see 
http://www.sei.cmu.edu/products/courses/p49.html 

[Schon] 

Donald  A.  Schon,  Technology  and  Change:  The  New  Heraclitus,  1967. 

©  2007  by  Carnegie  Mellon  University 


page  77 


Carnegie  Mellon 

Software  Engineering  Institute 

References 


[Siviy  04]  Siviy,  Jeannine  and  Eileen  Forrester,  Accelerating  CMMI  Adoption  Using  Six 

Sigma,  CMMI  Users  Group,  2004 

[Siviy  05-1]  Siviy,  Jeannine,  M.  Lynn  Penn,  M.  Lynn  and  Erin  Harper,  Relationships 

between  CMMI  and  Six  Sigma,  CMU/SEI-2005-TN-005 

[Siviy  05-2]  excerpted  from  working  documents  from  internal  SEI  research  on  the  joint 

use  of  Six  Sigma  and  CMMI;  refinement  of  guidance  and  subsequent 
publication  is  in  progress;  for  more  information,  contact 
jmsiviy@sei.cmu.edu 

[Siviy-Hefner  06]  Siviy,  Jeannine  and  Rick  Hefner,  Six  Sigma  Tools  for  Early  Adopters,  SEPG 

2006 

Definitions  from  electronic  statistics  textbook, 

http://www.statsoft.com/textbook/stathome.html,  and  engineering  statistics 
handbook,  http://www.itl.nist.gov/div898/handbook/prc/section1/prc16.htm 

Adapted,  with  permission,  from  information  provided  by  Robert  Stoddard, 
Motorola,  Inc. 

Idea  to  strategically  select  MA,  OPP,  QPM  as  first  PAs  in  which  to  achieve 
capability  5  offered  by  Robert  Vickroy,  ABS  Group,  at  CMMI  course  on  17 
january  2003 

www.iqa.org/publication/c4-1-38.shtml1 

Subramanyam,  V.,  Sambuddha  Deb,  Priya  Krishnaswamy  and  Rituparna 
Ghosh,  An  Integrated  Approach  to  Software  Process  Improvement  at  Wipro 
Technologies:  veloci-Q,  March  2004, 

http://www.sei.cmu.edu/publications/documents/04.reports/04tr006.html 


[stats  online] 

[Stoddard  02] 
[Vickroy  03] 

[wiprol] 
[Wipro  04] 


©  2007  by  Carnegie  Mellon  University 


page  78 


Carnegie  Mellon 

Software  Engineering  Institute 

Additional  Readings  1 


[A-M  99] 

Abdel-Malek,  Nabil  and  Anthony  Hutchings,  Applying  Six  Sigma  Methodology  to 
CMM  for  Performance  Improvement,  JP  Morgan,  European  SEPG  1999,  (slides 
available  to  SEIR  contributors  at  http://seir.sei.cmu.edu) 

[Arnold  99] 

Arnold,  Paul  V.,  Pursuing  the  Holy  Grail,  MRO  Today,  June/July  1999, 
www.Droqressivedistributor.com/mro/archives/editorials/editJJ1999.html 

[BPD] 

Process  Maturity  /  Capability  Maturity, 

http://www.betterproductdesiqn.net/maturitv.htm,  a  resource  site  for  the  Good 
Design  Practice  program,  a  joint  initiative  between  the  Institute  for  Manufacturing 
and  the  Engineering  Design  Centre  at  the  University  of  Cambridge,  and  the 
Department  of  Industrial  Design  Engineering  at  the  Royal  College  of  Art  (RCA)  in 
London. 

[Brecker] 
[Breyfogle  99] 

Linked  QFD  matrices  for  CTQ  trace-ability  from  http://www.brecker.com 

Breyfogle  III,  Forrest  W.,  Implementing  Six  Sigma:  Smarter  Solutions  Using 
Statistical  Methods,  John  Wiley  &  Sons,  1999 

[Bylinsky  98] 

Bylinsky,  Gene,  How  to  Bring  Out  Better  Products  Faster,  Fortune,  23  November 
1998 

[Demery  01] 

Demery,  Chris  and  Michael  Sturgeon,  Six  Sigma  and  CMM  Implementation  at  a 
Global  Corporation,  NCR,  SEPG  2001,  (slides  available  to  SEIR  contributors  at 
http://seir.sei.cmu.edu) 

[Forrester] 

[Gruber] 

Forrester,  Eileen,  Transition  Basics 

William  H.  Gruber  and  Donald  G.  Marquis,  Eds.,  Factors  in  the  Transfer  of 
Technology,  1965. 

©  2007  by  Carnegie  Mellon  University 


page  79 


Carnegie  Mellon 

Software  Engineering  Institute 


Additional  Readings  2 


[Harrold  99] 
[Harrold  99-2] 


[Harry  00] 
[Hefner  02] 


Harrold,  Dave,  Designing  for  Six  Sigma  Capability,  Control  Engineering  Online, 
January  1999,  http://www.controlenq.eom/archives/1 999/ctlOI 01 .99/01  al 03.htm 

Harrold,  Dave,  Optimize  Existing  Processes  to  Achieve  Six  Sigma  Capability, 
Control  Engineering  Online,  January  1999, 
http://www.controlenq.com/archives/1999/ctl0301 .99/03e301  .htm 

Harry,  Mikel,  Six  Sigma:  The  Breakthrough  Management  Strategy  Revolutionizing 
the  World’s  Top  Corporations,  Doubleday,  2000 

Hefner,  Rick  and  Michael  Sturgeon,  Optimize  Your  Solution:  Integrating  Six  Sigma 
and  CMM/CMMI-Based  Process  Improvement,  Software  Technology  Conference, 
29  April  -  2  May  2002 


[Hefner  02]  Hefner,  Rick  and  Michael  Sturgeon,  Optimize  Your  Solution:  Integrating  Six  Sigma 
and  CMM/CMMI-Based  Process  Improvement,  Software  Technology  Conference, 
29  April  -  2  May  2002 


[Hefner  03]  Hefner,  Rick  and  Ron  Ulrich,  Minimizing  SCAMPI  Costs  via  Quantitative  Methods  , 
Northrop  Grumman  Mission  Systems,  CMMI  Users  Group  Conference  2003 


[Stoddard  00]  Stoddard,  Robert  W.,  Implementing  Six  Sigma  in  Software,  Motorola,  Inc., 

Software  Engineering  Symposium  2000,  (slides  available  to  SEIR  contributors  at 
http://seir.sei.cmu.edu) 

[isixsigma]  From  http://isixsiqma.com 


©  2007  by  Carnegie  Mellon  University 


page  80 


Carnegie  Mellon 

Software  Engineering  Institute 

Online  Resources 


Online  Statistical  Textbooks 

Computer-Assisted  Statistics  Teaching  -  http://cast.massev.ac.nz 
DAU  Stat  Refresher-  http://www.cne.qmu.edu/modules/dau/stat/dau2  frm.html 
Electronic  Statistics  Textbook  -  http://davidmlane.com/hyperstat/index.html 
Statistics  Every  Writer  Should  Know  -  http://nilesonline.com/stats/ 

Six  Sigma  Resources 

isixsigma  software  channel  -  http://software.isixsiqma.com 

SEI  Measurement  &  Analysis  Initiative  -  http://www.sei.cmu.edu/sema 
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